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Abstract 

Past  and  current  U.S.  Army  computational  vision  models  designed  to  determine  the 
difficulty  of  visual  detection  of  camouflage  for  military  vehicles  are  extremely  limited  in 
the  sense  that  they  do  not  encompass  much  of  the  brain  outside  the  retina  and  visual 
cortex,  and  within  those  areas,  do  so  to  a  very  limited  degree.  A  method  and  preliminary 
experiments  to  obtain  the  raw  data  to  construct  better  and  more  representative  models  of 
human  vision  and  cognition  is  presented.  The  inclusion  of  specific  neurocircuitry  in  the 
computational  model  as  opposed  to  the  “black  box”  standard  used  in  psychophysics  is 
now  possible.  The  combination  of  psychophysics  and  fMRI  has  the  potential  to  give  a 
more  complete  view  of  the  neural  systems  that  are  relied  on  for  different  perception  tasks 
related  to  camouflage  and  deception. 

Introduction 

The  general  purpose  and  mission  of  the  U.S.  Army  RDECOM-TARDEC’s  Visual 
Perception  Laboratory  (VPL)  is  to  measure  the  probability  of  detection  of  ground  combat 
vehicles  with  various  camouflage/stealth  treatments  and  how  those  treatments  compare  to 
untreated  vehicles.  The  data  collected  in  the  VPL  is  used  to  assess  the  effectiveness  of 
camouflage  treatments  as  well  as  to  validate  and  improve  U.S.  Army  visual  and  infrared 
detection  models.1  Standard  photosimulation  methods  can  only  proceed  so  far  in  model 
development  and  assessment.  For  a  deeper  understanding  of  the  cortical  processes 
involved  in  camouflage  assessment,  a  new  technology  is  needed. 

Procedures  that  use  Magnetic  Resonance  Imaging  (MRI)  to  measure  the  functional 
localization  of  neural  processes  (via  changes  in  blood  flow  and  related  hemodynamic 
parameters)  have  been  widely  adopted  because  of  their  relative  good  temporal  resolution 
(100-1000  msec)  and  ever-increasing  spatial  resolution  The  use  of  MRI  in  this  context  is 
conventionally  called  “functional  Magnetic  Resonance  Imaging”  (fMRI).  Many  of  the 
early  studies  concerned  the  use  of  fMRI  for  probing  visual  perception  2,3  and  while 
subsequent  years  have  shown  a  growing  range  of  applications,  there  continues  to  be  a 
substantial  amount  of  current  research  applying  fMRI-based  experiments  to  questions 
associated  with  vision.4'3  There  is,  therefore,  a  large  literature  of  general  brain  mapping 
studies  concerned  with  visual  perception  that  fonns  the  foundation  for  this  research.  The 
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Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
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1.  REPORT  DATE 

03  AUG  2005 


2.  REPORT  TYPE 


3.  DATES  COVERED 


4.  TITLE  AND  SUBTITLE 

fMRI  for  functional  localization  and  task  difficulty  assessment  during 
visual  search  for  military  vehicles 

6.  AUTHOR(S) 

Thomas  Meitzler;  Darryl  Bryk;  Euijung  Sohn;  Joyce  Hirsch 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

US  ARMY  TACOM,6501  EAST  11  MILE  RD, WARREN, MI, 48397-5000 


5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

5d.  PROIECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 

15099 


9.  SPONSORING/MONITORING  AGENCY  NAME(S )  AND  ADDRESS(ES )  10.  SPONSOR/MONITOR' S  ACRONYM(S) 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

14.  ABSTRACT 

Past  and  current  U.S.  Army  computational  vision  models  designed  to  determine  the  difficulty  of  visual 
detection  of  camouflage  for  military  vehicles  are  extremely  limited  in  the  sense  that  they  do  not  encompass 
much  of  the  brain  outside  the  retina  and  visual  cortex,  and  within  those  areas,  do  so  to  a  very  limited 
degree.  A  method  and  preliminary  experiments  to  obtain  the  raw  data  to  construct  better  and  more 
representative  models  of  human  vision  and  cognition  is  presented.  The  inclusion  of  specific  neurocircuitry 
in  the  computational  model  as  opposed  to  the  "black  box"  standard  used  in  psychophysics  is  now  possible. 
The  combination  of  psychophysics  and  fMRI  has  the  potential  to  give  a  more  complete  view  of  the  neural 
systems  that  are  relied  on  for  different  perception  tasks  related  to  camouflage  and  deception. 


15.  SUBIECT  TERMS 


16.  SECURITY  CLASSIFICATION  OF: 


a.  REPORT 

unclassified 


b.  ABSTRACT 

unclassified 


c.  THIS  PAGE 

unclassified 


17.  LIMITATION  OF 

18.  NUMBER 

ABSTRACT 

OF  PAGES 

12 

19a.  NAME  OF 
RESPONSIBLE  PERSON 


Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


authors  propose  to  use  this  technology  for  vehicle  detection  model  development  and 
testing  as  well  as  for  the  augmentation  of  conventional  perception  lab  testing. 

Method 

Images  of  cortical  activity  were  taken  using  a  1.5  T  Magnetic  Resonance  Scanner 
(General  Electric  Twin  Speed,  see  Fig.  1)  using  the  echo  planar  or  equivalent  option  and 
a  typical  T2*  weighted  gradient  echo  sequence  such  as  (TE=40  ms,  TR=2  secs,  flip  angle 
=  60  deg).  A  40  x  20  cm  field  of  view  (FOV)  imaged  on  a  256  x  128  grid  yielding  an  in¬ 
plane  resolution  of  1.56  x  1.56  mm  and  slice  thickness  of  5mm  and  voxel  size  of 
(3x3x4. 5mm,  20x20  cm  FOV,  64  x  64  grid)  was  used  for  the  present  study.  Images  were 
acquired  on  multiple  contiguous  slices  chosen  to  cover  the  entire  human  brain. 


Fig.  1:  Columbia  University  fMRI  scanner,  Courtesy  of  Dr.  Hirsch 
Methodology 

The  proposed  procedure  for  using  fMRI  for  rapid  camouflage  assessment  and  search  task 
localization  is  to  present  a  set  of  images  of  military  ground  vehicles  to  a  subject  using  a 
rear  projection  screen  while  they  are  lying  prone  inside  the  magnet  and  have  the  subject 
indicate  by  means  of  a  track  ball,  the  location  of  the  vehicle.  The  images  were  shown  to 
subjects  while  they  were  being  imaged  in  the  same  manner  that  subjects  are  shown  the 
image  in  the  visual  perception  lab  at  TARDEC  minus  the  condition  of  the  subjects  being 
in  a  prone  position.  The  images  were  randomized  over  subjects. 

The  image  sequence  used  was  as  follows:  first  a  random  dot  pattern  was  shown  for  two 
seconds  to  clear  retinal  memory,  then  the  stimuli  image  was  shown  for  ten  seconds  in 
which  there  may  or  may  not  be  a  military  vehicle,  then  a  black  image  was  displayed  to 
for  eight  seconds  shut  down  the  visual  system.  In  all  cases,  the  background  was  the  same. 
The  design  matrix  was  seven  ranges,  one  target,  three  screen  locations  of  the  vehicle,  and 
twenty-five  percent  no-target  images. 


Below  in  Fig.  2  is  a  stimuli  image  that  is  part  of  the  data  set  shown  to  the  pilot  test 
subjects.  The  target  vehicle,  which  in  this  test  was  a  5  ton  truck,  is  in  the  center  of  the 
image.  The  image  set  used  is  part  of  a  TARDEC  and  Marine  test  on  electro-optical  filters 
for  laser  protection  at  29  Palms  in  New  Mexico. 


Fig.  2:  5  Ton  truck  at  700m 


Data  Analysis 

During  the  presentation  of  the  test  imagery,  response  data  was  accumulated  for  standard 
signal  detection  type  of  analysis  for  comparison  to  the  fMRI  data  as  shown  in  Fig.’s  3,  4 
and  5  below. 


Fig.  3:  Average  search  time  for  the  truck  at  each  range 


fMRI  average  time  response  to  the  image 
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Fig.  4:  Average  search  times  for  the  truck  at  each  range  and  screen  position 


Fig.  5:  Average  detection  probabilities  for  each  image 


Figures  6  through  12  below  are  the  results  of  the  Statistical  Parametric  Mapping  (SPM) 
of  the  fMRI  data  for  one  of  the  subjects.  The  data  indicate  the  large  amount  of  neural 
activity  associated  with  searching  for  targets.  The  SPM  program  is  run  using  MATLAB.6 
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Fig.  6:  No-target  image  SPM  results 
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Fig.  7:  Range  1  SPM  results 
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Fig.  8:  Range  3  SPM  results 


[-18,-64,4?] 


p=.05.  sub  05 

Statistics :  p-values  adjusted  for  search  volume 

seMeuej  _ cluster-level _  _ voxel-level 

C ^  paretoi  "  E_ P  PfCJE-cmt  ^FPR-omt  1 


2  4  6  $ 

Desiqn  matrix 


IZgl 


x,y,z  fmm> 


0.045 


L9 


E4ZE  0.045 


L.000  L54  0.E04 

L.000  Z95  0.’L4 


L.000  4b  0.90’ 
L.000  L5  D.FF4 
L.000  Z’  0.954 
L.000  5  0.9’E 
L.000  55  O.E9b 
L.000  ZL  0.944 
L.000  L5  0.955 
L.000  54  0.9Z5 

L.000  Z’  0.954 


O.OZE  0.Z95 
1.113  1.29b 
1.3b)  1 .314 
0.9E5  0.E4E 
1.99b  I.E4I 
0.995  0.b4E 
1.991  I.E4I 
1.999  I.E4I 
0.999  0.E4E 
0.999  0.E4E 
L.000  0.E4E 
L.000  0.E4E 
L.000  0.E4E 
L.000  0.E4E 
L.000  0.E4F 
L.000  0.E4E 
3. Ill  I.E4I 
L.000  0.E4E 


0.000 

■  .III 

■  .III 

0.00b 

I  .119 

O.OOE 

I  .1)1 

I  .1)3 
0.0L4 
0.DL5 
0.0L9 
0.0L9 
O.OZO 
O.OZL 
0.0Z5 
0.0Z4 

0.0Z9 


Fig.  9:  Range  4  SPM  results 
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Fig.  10:  Range  5  SPM  results 
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Fig.  11:  Range  6  SPM  results 
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Fig.  12:  Range  7  SPM  results 


Conclusions 

The  fMRI  maps  indicate  that  there  is  a  substantial  amount  of  cortical  processing 
occurring  during  visual  search.  Active  areas  include  functional  areas  associated  with 
early  and  late  vision,  language  fonnation,  and  memory.  The  data  show  clear  activation  of 
the  early  and  ventral  visual  areas,  LO,  and  parietal  regions.  Computational  models 
therefore  need  to  include  these  areas  of  the  brain  to  more  accurately  represent  the  human 
visual  detection  process.  Most  importantly,  the  activities  in  these  areas  can  now  be 
measured,  as  is  indicated  by  the  tables  accompanying  some  of  the  figures,  and  used  for 
visual  search  and  detection  model  development  and  testing. 

Current  and  future  work  lies  in  the  area  of  assimilating  the  data  obtainable  from  the  fMRI 
maps  in  to  a  computer  model  that  encompasses  all  of  the  active  areas  of  the  brain 
revealed  by  the  fMRI  maps. 
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